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His series of experiments is an analy- 
Bins of some properties of behavioral 
control by stimuli which are aversive be- 
cause positive reinforcement is discon- 
tinued. The basic paradigm used in these 
investigations for studying this kind of 
control uses a “time out” from positive 
reinforcement as the aversive event. To 
study the effect of the time out, a simple 
response, such as a pigeon’s peck at a ¢ ir- 
cular disk, or a chimpanzee’s press ol a 
toggle switch, was maintained when oc- 
casional pecks or presses were followed 
with food. Reinforcements became avail- 
able on a variable schedule, which pro- 
duced sustained responding at substan- 
tial rates. The resulting performance 
then served as a base line on which to 
assess the effects of the introduction of 
the aversive stimuli. To generate the 
aversive event, reinforcement was with- 
held in the presence of one stimulus but 
alternately continued in the presence of 
a second stimulus. When the rate of re- 
sponding fell to zero in the presence of 
the reinforcement 
discontinued, that stimulus, called the 
time-out stimulus, could then be used as 


stimulus where was 


? This study is part of a project supported by 
the United States Atomic Commission 
under Contract AT- (40-1)-1553- 

? The part of Experiment IV using pigeons was 
carried out in the Department of Pharmacology 
of the Harvard Medical School. Thanks are due 


Energy 


to Otto Kraver and P. B. Dews for making the 
facilities available. 

> Now at the Institute for Psychiatric Research, 
Indiana University Medical Center. 
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an aversive event and its effect on the 


base-line performance measured. 


The “time out” is useful for interrupting an 
experiment, since all that is required is that a 
stimulus be changed. Hence, the time out has 
been used: 


1. To begin and end experimental sessions (6). 


A time out at the beginning of the experiment 
enables effects of handling the animal to disap 
pear before the experiment is started; a time out 
at the end of the experimental session terminates 
the daily session without the presence of the 
experimenter 

2. In drug experiments, by interrupting the 
experiment with a time out and continuing the 
experiment some time later when the drug has 
had its maximum effect (3) 

3. As a way of analyzing and controlling the 
temporal properties of the animal's past be- 
havior on a current performance (7). For ex- 
ample, the discriminative effects of the reinforce 
ment can be minimized if it is followed by a 
time out, so that, when the experiment is re 
sumed, a period of time has elapsed during which 
the reinforcement would have been effective. 

\ time out from positive reinforcement has 
been used to punish responses in the develop- 
ment of a discrimination, or differentiation. The 
aversive properties of a time out were also evi 
dent in experiments where a time out scheduled 
during a fixed-ratio performance disrupted the 
performance severely, because the high fixed 
ratio rate of responding resulted in an inevitable 
correlation of the time out with a response (7). 

Finally, Morse and Herrnstein, using pigeons 
demonstrated that behavior could be maintained 
because it postponed a time out (13). 


The primary aversive stimuli have rel- 
atively fixed effects. In contrast, the effect 
of the time out is determined by the 
schedule of reinforcement it interrupts. 
At extreme values of some schedules of 
reinforcement, the time out may become 
positively reinforcing instead of aversive. 
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Morse and Herrnstein studied this prop- 
erty of the time out in the extreme case 
by experiments in which pigeons were re- 
inforced on (a) large values of fixed-inter- 
val schedules, or (b) schedules in which 
low rates were differentially reinforced; 
that is, responses were reinforced only 
when they were spaced at least five min- 
utes from a preceding response (9). They 
found that the stimuli associated with 
these schedules were aversive, since the 
pigeon had a strong disposition to peck 
a second key which interrupted the ex- 
periment for a long interval of time (e.g., 
three minutes). 

Most of the punishments in human 
affairs involve the withdrawl of positive 
reinforcements (time out) rather than 
primary noxious events, or aversive stim- 
uli. Jails, discharge from employment, 
and ostracization are a few of the more 
extreme forms. Even when corporal pun- 
ishment is used, as for example in par- 
ental control of children, its effect is con- 
founded with time out from positive re- 
inforcement. A parent who spanks a 
child is less likely to provide the normal 
positive reinforcement. 

Because the function of the time out 
depends (at least at extreme values) on 
the schedule of reinforcement from which 
it is derived, a single schedule of rein- 
forcement and body weight was used in 
all of the experiments reported here. (An 
exception was made in the part of Exp. 
III using pigeons.) A variable-interval 
schedule with a mean of three minutes 
(VIg) was chosen as a moderate value. 
The average interval between reinforce- 
ments was three minutes, and the actual 
intervals were randomized between zero 
(successive responses) and six minutes. 
, Such a will 
normally produce a moderate and near- 
constant rate of responding. Further- 
more, the experimental session is long 


variable-interval schedule 


enough to impose repeated stimulus 
conditions, and also to minimize the rela- 
tive importance of behaviors associated 
with too frequent eating. At the same 
time, the reinforcements occur frequently 
enough to prevent the schedule of rein- 
forcement from becoming aversive. 


SUBJECTS 

The subjects of the experiments were 
two adult chimpanzees, Yerkes Colony 
No. 67 (Jed) and No. 97 (Verb), 10 and 
15 years old, respectively. The animals 
had a prior history in various manual 
discrimination experiments. In Exp. III, 
the subjects were two White Carneaux 
male pigeons, approximately two years 
old. They had a history of variable-inter- 
val reinforcement, during which their 
weights were varied. 


APPARATUS AND PROCEDURE 


The principles used in the design of 


the apparatus were described elsewhere 
(6). 


Ihe chimpanzees’ living quarters tonsisted of 
a room (12 by 12 feet) adjoining a fenced en- 
closure (15 by 15 feet), The apparatus was per- 
manently mounted in the indoor portion (the 
experimental chamber). While one subject took 
part in the experiment, the second subject was 
locked out in the fenced enclosure. A scale per- 
manently mounted from the ceiling of the ex- 
perimental cage was used to weigh the animals 
before each experimental session. The animals 
were trained to hang quietly from the scale by 
successwe approximation of the final behavior 
(18). Then, hanging from the rein 
forced only when an appropriate light was on, 
so that the animals could be weighed at any time 
simply by turning on the light. The behavior 
recorded was the operation of a telephone-type 
key, 30 inches from the floor. The food magazine 
delivered alternate 50-calorie portions of hard 
whole wheat cracker and Purina monkey chow 
into a food tray 12 inches to the left of the key. 
Control and recording equipment were kept in 
an adjoining room. 

Number 97 entered the experimental chamber 
at g:go0 A.M. and remained until 4:00 P.M.; No. 
67 entered at 4:30 P.M. and remained until 
aM, The animals were kept in the same 


scale was 


8:00 
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TIME OUT 


room between 8:00 and g:00 A.M., when both 
compartments were cleaned. The beginning and 
end of the experimental sessions were marked 
by the presentation and withdrawal of an over 
head light. The daily session was terminated 
when the animal received 55 to 60 reinforce- 
ments, or when eight hours elapsed, whichever 
came first. The absence of the light controlled 
a near-zero rate of key pressing, because of dif- 
ferential reinforcement before the start of the 
experiment. 

The animals were maintained at approxi- 
mately 80%, of their free-feeding body weight. 
They were fed a supplement of yeast tablets, two 
oranges, and four ounces of evaporated skim 
milk after the experimental session, when they 
went to the outside part of the living quarters 
Any day when an animal's weight exceeded its 
designated experimental weight, the experi- 
mental session was postponed and the animal 
fed only supplementary rations. Extra food was 
given after the experimental session whenever 
the subject’s weight fell below the designated 
experimental weight for several days. 

The time out was programmed by shutting 
off the lights in the experimental room and 
disconnecting the reinforcing circuits, Any re 
sponse occurring during the time out extended 
its full duration, The recorder paper feed did 
not run during the time out. Any responses oc 
curring would be noted by a vertical rise in the 
recording pen. The rate of responding remained 
essentially zero during the time out. In all of the 
experiments the time out lasted 10 minutes 
except in the occasional instances where a re- 
sponse during the time out prolonged it. The in 
tervals in the variable-interval schedule averaged 
three minutes and ranged from several seconds 
to six minutes in an arithmetic progression, ex 
cept for a slightly lessened density of short inter- 
vals. The variable-interval schedule used with 
the pigeons in Exp. III averaged six minutes, 
varying from several seconds to 12 minutes 

The apparatus used with the pigeons in Exp. 
III is described elsewhere (6). No reinforcement 
could occur when a response produced a time 
out. 

The actual order in which the experiments 
were carried out was I, II, IV, V, and III. 


EXPERIMENT I. THe Pre—Time-Ou1 
STIMULUS 
The suppression of behavior by a 
stimulus preceding an aversive event 
(pre-shock, pre-time-out, or pre-aversive 
stimulus) is an important case in a survey 


of the properties of an aversive stimulus. 
This is the experimental paradigm first 
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demonstrated by Estes and Skinner (5) 
and later extensively used by Brady and 
Hunt (2). Herrnstein, extending the pre- 
aversive procedure to the time out, found 
that the sup- 
pressed behavior only when the rein- 


pre-time-out stimulus 
forcement was given very frequently— 
e.g., a variable-interval schedule with a 
mean of go seconds. At higher mean 
values of the variable-interval schedule, 
however, the pre—time-out stimulus con- 
trolled a higher rate of responding than 
the prevailing interval rate. Herrnstein 
interpreted this increased rate as positive 
reinforcement by the time out because 
of the aversive properties of the schedule 
of positive reinforcement (8). 

This experiment investigates the pre- 
time-out procedure in the chimpanzee at 
a moderate value of the variable-interval 
schedule, chosen to emphasize the aver- 
sive properties of the time out rather 
than the schedule of reinforcement, 


Procedure 


variable- 
interval schedule for 65 hours following one ses 
sion of continuous reinforcement. The 3o-second, 
pre-time-out stimulus was a red lamp just above 
the key. The red light appeared at various inter- 
vals, averaging every 10 minutes, Reinforcements 
occurred on the three-minute, variable-interval 
schedule, independently of the red light. The red 
light was not followed by the time out for the 
first two sessions of the experiment. On the third 


The subjects were reinforced on a 


session, the first response 30 seconds after the 
appearance of the red light produced a time out 
that interrupted the experiment for 10 minutes. 
During the remainder of the experiment, the 
effect of the red light on the rate of responding 
was measured with and without the 
time out following the red light. To check for 
artifacts, were carried out in 
which the red light was disconnected, but all of 
the recording circuits were still in effect. 


variously 


control sessions 


Results 

Figure 1 contains summary graphs of 
the whole experiment for both animals 
showing the ratio of the rate of respond- 
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IN THE RED LIGHT 


RELATIVE RATE OF RESPONDING 


Fic. 2. 


stimulus and over-all rate of responding. Each point is the average of an entire daily session. 
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Chimpanzees No. 67 and 97. The relative rate of responding during the pre-time-out 


ing during the pre-time-out stimulus to 
the over-all rate. The time out increases 
the rate of responding in the presence of 
the pre-time-out stimulus, although the 


effect is not completely reversible. The 
highest relative pre-time-out rates of re- 
sponding occurred when the over-all rate 
was low. 
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TIME OUT FROM 

Rate of responding during the pre- 
time-out stimulus relative to the over-all 
rate of responding. Before the time out 
was introduced, the rate during the red 
light was low for both animals. After the 
time out introduced, the rate of 
responding in the presence of the red 
light increased for both animals and re- 
mained considerably above the over-all 
rate. When the time out discon- 
tinued in Session 12, the rate of respond- 
ing during the red light fell for both ani- 
mals. Number 97's rate quickly reached a 
value approximating the general level 
of responding. Number 67, however, 
showed many sessions in which the rate 
of responding during the red light in- 
creased to values as high as the previous 
procedure with the time out. When the 
time out again followed the red light, 
No. 67's pre-time-out 


was 


was 


increased 
markedly, reaching approximately 1.7 


rate 


times the over-all rate; and on two ses- 
sions it reached 2.9 and 2.4 


times the 
over-all rate. Number 97 also showed an 
increase over the pre-time-out rate of 
responding; but this increase was not so 
marked as that of No. 67. The rate dur- 
ing the red light reached approximately 
the same value as during the previous 
time-out procedure. 

When the time out was discontinued 
for a second time, the rate of responding 
during the go-second period of red light 
remained high. To control for possible 
artifacts, sessions were carried out in 
which the red light was disconnected, 
with the recording program remaining as 
before. Both animals rates of 
responding approximately equal to the 
over-all rate. 


showed 


To investigate the continuing control 
of a high rate by the red light in the ab- 
sence of the time out, the stimulus con- 
ditions were then reversed. The red light 
remained on for the bulk of the session, 
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and the pre—time-out stimulus became a 
go-second period in which the red light 
was off. The rate of responding during 
the go-second intervals in which the red 
light was off fell relative to the over-all 
rate during the rest of the session when 
the red light was on. The rate fell to the 
value of the over-all rate, but not below 
it. When the original stimulus conditions 
were restored (the time out still not fol- 
lowing the red light), the rate of respond- 
ing again increased, reaching the level 
present before the reversal of the stimu- 
lus conditions. For No. g7, the rate dur- 
ing the red light then reached the high- 
est rate of responding yet observed. 
Over-all rate of responding. The over- 
all rate of responding, shown in the sec- 
shows a 


Fig. 1, relation 


both to the introduction and removal of 


ond curves of 


the time out and the relative rate of re- 
sponding during the red light. The over- 
all rate of responding fell when the me 
out was discontinued (Sessions 12-27) 
and rose markedly when it was reintro- 
duced (Session 28). The second removal 
of the time out had no obvious eflect, 
but the reintroduction of the time out on 
Session 66 was accompanied by another 
marked rate increase. Number 97, in Fig. 
1, showed a similar effect of the time out. 
The over-all rate increased on Session 23, 
when the time out was reintroduced, and 
fell on Session 39, when it was discon- 
tinued. The rate fell again on Session 59, 
with no time out, and increased on Ses- 
sion 61, with its reintroduction. 

The highest relative pre-time-out rates 
of responding occurred when the over-all 
rate was low. For No. 67, on Sessions 33, 
jo, 50, and 65, peak values of the pre- 
time-out rate of responding occurred 
with the lowest values of the over-all rate 


of responding. Conversely, when the 


over-all rate reached its peak values, the 
relative rate during the red light tended 


MINUTES 


formance during the pre-time-out stimulus only 


to fall. Note, for example, that the two 
curves cross frequently. Number 97 (Fig. 
1) shows a similar performance. Peak 
values of the relative pre-time-out rate 
are associated with the lowest values of 
the over-all rate (Sessions 10, 44, and 
60). However, there is no relation be- 
tween high over-all rates and low values 
of the relative pre-time-out rate, as with 
No. 67. 
Figure 2 the cumulative 
curves of an entire daily session, showing 


contains 


the performances for both animals, when 
the highest relative pre-time-out rates of 
responding were observed (at the points 
marked a in Fig. 1). In each case, Record 
1 contains the entire performance, and 
Record 2 contains only the behavior dur- 
ing the pre-time-out stimulus. The di- 
agonal marks indicate the start of the go- 
second period during which the red light 
was on; reinforcements and the position 
of the time out are not marked on the 
curves. The grid in the lower right part 
of the figure gives the coordinates, the 
scale of the record, and several reference 
slopes in responses per second. 

In Records A-1 and A-g, the goth ses- 
sion for No. 67, the pre-time-out rate 


CHARLES B. FERSTER 


Fic. 2, Chimpanzees No, 67 and g7, Cumulative curves of an entire daily session showing the 
highest pre-time-out rates of responding relative to the over-all rate. Record B contains the per 


10 MINUTES 


was 2.9 times as high as the over-all rate. 
The over-all rate of responding was low, 
with: highest rates of the session occur- 
ring during the pre-time-out period. Oc- 
casional low rates appeared during the 
pre-time-out stimulus, as well as high 
rates elsewhere. The performance for No. 
97 in Records B-1 and B-2 was similar, 
except for a higher over-all rate, show- 
ing more sustaining responding. The rec- 
ord contains the egth session, where the 
pre—time-out rate was 1.6 times the over- 
all rate. Here, the rates of responding 
during the pre-time-out stimulus were 
frequently higher than any appearing 
elsewhere. Occasional instances occurred 
where the rate during the red light was 
lower than the prevailing rate. 

When the pre-time-out rate was low 
relative to the over-all rate, the absolute 
values of the pre-time-out rates of re- 
sponding were still substantial. In the 
main, the effect of the pre-time-out 
stimulus was to sustain responding rather 
than increase the local rate. 


Discussion 


The pre-time-out procedure produces 
an increase in rate of responding during 
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the pre—time-out stimulus, rather than a 
decrease, as with the preshock stimulus. 
In this experiment the increased rate 
during the pre-time-out stimulus can- 
not be interpreted as behavior rein- 
forced by an aversive variable-interval 
schedule of reinforcement. Moderate 
schedule values were used; and, as Ex- 
periments III, IV, and V show, the inter- 
ruption of the same schedule of rein- 
forcement in the same animals is a highly 
aversive event. 

Examination of the temporal relations 
of responses during the pre-time-out 
stimulus, the reinforcement, and the time 
out may suggest a basis for the increase 
in rate during the pre-time-out stimu- 
lus. The likelihood that a given response 
will produce a time out is high after a 
pause because the time out occurs at a 
fixed interval following the appearance 
of the red light. In the extreme case a 
response spaced go seconds from a pre- 
vious response will always produce a time 
out. Conversely, only a small fraction of 
responses emitted at higher rates pro- 
duces time outs. The result is a differ- 
ential punishment of spaced responding 
because spaced responses are more likely 
to produce a time out. Also, the likeli- 
hood of a reinforcement following long 
pauses is low. Pauses of go seconds or 
more during the pre-time-out stimulus 
are never reinforced. This contingency is 
somewhat similar to schedules of rein- 
forcement where 


the reinforcement is 
set up” for a brief period of time 
(limited hold) rather than the normal 
procedure of the reinforcement being 
held indefinitely (7). The above con 
tingencies produce large effects when 
programmed explicitly. Experiment V 
shows that the selective punishment of 
spaced responding is effective in control- 
ling the rate of responding. Experiments 
with pigeons and rats have shown effec- 
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tive control of the rate of responding 
when reinforcement is withheld until a 
response occurs at the designated value 
(16, 17, 19). 

The fact that the pre-time-out rate of 
responding generally did not exceed the 
highest prevailing rate elsewhere during 
the session also suggests that a major 
effect of the time out is to eliminate long 
pauses. 

Both animals confirm the effect of the 
time out in increasing the over-all rate 
of responding (see Exp. II). Therefore, 
the effect of the time out might not be 
completely under the control of the red 
light, or the time out may have effects 
other than the contingencies in the red 
light described above. Because the time 
out following the red light produces sus- 
tained responding at the highest prevail- 
ing rate during the pre-time-out stimu- 
lus, its effect is more marked at lower 
over-all rates of responding. This con- 
firms Herrnstein’s finding that the rela- 
tive rate during the pre-time-out stimu- 
lus increased when the frequency of re- 
inforcement was deceased. The over-all 
rate of responding declined as reinforce- 
ments occurred less frequently. 

The failure of the pre-time-out rate 
of responding to return to the level of 
the base-line rate after the time out no 
longer occurred indicates a large order of 
magnitude of control. There was no indi- 
cation that the pre-time-out rate was 
falling during the 29 sessions in which 
the time out no longer followed the go- 
second, red-light period. The apparent 
irreversibility of the process might be 
due at least partially to the fact that the 
discontinuance of the time out did not 


provide any new contingency opposed in 
effect to the time out. 

As in Experiments III, 1V, and V, No. 
67 showed a greater sensitivity to the ef- 
fects of the time out than did No. 97. 
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EXPERIMENT IJ. THe EFFECT OF A PERI- 

opic TiMeE OuT ON THE OvER-ALL RATE 

OF RESPONDING ON VARIABLE-INTERVAL 
REINFORCEMENT 


The effect of a time out in increasing 
the rate of responding on a variable-in- 
terval schedule was confirmed during the 
preliminary conditions of the avoidance 
experiment reported in Exp. IV. The 
avoidance procedure of Exp. IV_ pro- 
duced a condition where the perform- 
ance on the variable-interval schedule of 
food reinforcement was periodically in- 
terrupted by a time out, because no be- 
havior had yet developed on the avoid. 
ance lever to postpone time outs. The 
periodic interruption of the experiment 
produced a marked increase in the over 
all rate of responding. The avoidance ex- 
periment was then postponed so that the 
effect of the time out on the variable 
interval rate might be examined in more 
detail. 


Procedure 


The performance the variable-interval 
schedule was compared with and without time 
out. In the time-out procedure the subjects had 
access to the three-minute, variable-interval food 
reinforcement for intervals, 
separated by three minutes when the time-out 
stimulus was present 


schedule 6o-second 
The time-out procedure 
was compared with a control procedure of three 
minute, variable interval reinforcement without 
interruptions, In chimpanzee No. 67 the effects 
of time out and 
alternate sessions for 


out studied in 
the first four sessions, The 
fifth and sixth sessions began without time out 
for the first hour, followed by the time-out pro- 
cedure for the remainder of the session. In chim- 
panzee No. 97 the time out was studied in alter 
nate sessions for the first two sessions, For the re 
maining four sessions of the experiment the 
procedure changed after the first hour of the 
session, In the began with 
time outs during the first hour, and in others 
with no time out. The previous history of the 
subjects is recorded in Exp. I. 


ho time were 


some cases session 


Results 


Che rate of responding with the time- 
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out procedure was always higher than 
without the time out. The ratio of rates 
of responding under time-out and no- 
time-out conditions ranged between 5.1 
and 2.3 for No. 67 and 3.7 and 1.6 for 
No. 97. 

Records A and B of Fig. 3, which con- 
tain the entire fourth and fifth sessions 
for No. 67, show a more detailed account 
of the effect of the time out. The re- 
corder paper feed stops during the time 
out. Reinforcements marked by the 


diagonal lines on the record. In Record 


are 


A the session began with three-minute, 
variable-interval with 


time outs every minute. After one hour 


reinforcement, 


of variable-interval reinforcement (at the 
arrow), time outs were discontinued for 
the remainder of the session. The rate 
of responding fell within 10 minutes and 
showed a continuing decline through the 
remainder of the session. On the follow- 
ing day, shown in its entirety in Record 
B, the session began with variable-inter- 
val 


time outs. 


\fter an hour (at the arrow), the time- 


reinforcement, with no 
out procedure was reinstated for the re- 
mainder of the session. The rate of re- 
sponding increased as soon as the time 
out was added. Pauses up to go seconds 
occur after many time outs. These pauses 
following time outs also occurred in Exp. 
III, and have been previously reported 
by Herrnstein in other experiments using 
variable-interval reinforcement and time 
outs with a pigeon (8). 

Number 97, the animal with the 
higher over-all rate, showed the same ef- 
fect of the time out. The first discon- 
tinuation of the time outs was immedi- 
ately followed by a fall in rate. On the 
following day, when the time out was 
reintroduced after an hour, the rate of 
responding increased, interrupting the 
progressive decline in rate that is a usual 
variable-interval 


characteristic of per- 


: ‘ 


Fic. 3. Chimpanzee No. 67. Record A: 
session is no longer interrupted. Record B 
sion is interrupted every minute 


formances. The pauses following time 
outs were more marked for this animal 
than for No. 67. 

The periodic time out has similar ef- 
fects when the entire inter- 
rupted. Figure 4 contains two successive 
daily sessions for No. 97, comparing the 


session is 


performances with and without time out. 
Record A, without time out, shows a low 
over-all rate of responding with marked 
negative curvature during the session, 


TIME OUT FROM POSITIVE REINFORCEMENT 


The session is interrupted every minute 
The following session 


j- Chimpanzee No. 97. Record A: A complete daily session without interruption, Record B: The 
session following Record A, where the session is interrupted every minute 


A 
9} 


10 MINUTES 


At the arrow the 
Beginning at the arrow, the ses 


reaching near zero by the end of the ses- 
sion. On the following day (Record B) 
the periodic interruption of the experi- 
ment increased the over-all rate by a fac- 
The 
over-all rate was caused by sustained re- 
sponding rather than higher local rates 
of responding. Segments at a, b, c, and 
d, in Record A, for example, were 
emitted at the prevailing rate of Record 
B. Brief pauses follow most of the time 


tor of more than two. increased 
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outs, as the wavy character of the record 
indicates. ‘They are especially marked in 
the region e to f and at g and h. 


Discussion 


The increased rate of responding when 
the variable-interval reinforcement pro- 
cedure was periodically interrupted con- 
firms the effect of the time out on the 
rate of responding during the pre-time- 
stimulus in Exp. I. The 
amount of food per unit of time under 
the time-out conditions confounds the 
result somewhat; but the rate of food 
ingestion is probably not a large enough 
factor to produce the order of magni- 
tude of rate changes reported here. Un- 
der the highest rate of food delivery, re- 
inforcements are still spaced on an aver- 


out lesser 


age of every three minutes. Contingencies 
are present in this experiment (similar to 
those already described in Exp. I) which 
could be responsible for the increased 
rate of responding when the session is 
interrupted periodically. The likelihood 
of a time out occurring is higher after 
longer pauses than shorter pauses. Hence, 
the class of reinforced responses will be 
partially restricted in the direction of re- 
sponses spaced closely, because a higher 
proportion of distantly spaced responses 
will produce time outs (hence no rein- 
forcement) than closely spaced responses. 
This lower frequency of reinforcement 
is tantamount to the reinforcement of 
higher rates. The contingency here is 
that of reinforcement 
the reinforcement is 
“set up” for a brief period rather than 


also similar to 


schedules where 
being available until the next response 
(limited-hold reinforcement). The rein- 
forcement on a limited-hold basis reduces 
likelihood of reinforcement after 
long pauses, just as in the time-out pro- 


the 


cedures of Exp. I and II, and increases 
the rate of responding. 


B. FERSTER 


THE SUPPRESSION OF 


A STIMULUS PRECEDING A 


EXPERIMENT III. 

BEHAVIOR BY 

TIME OUT FROM A SCHEDULE OF 
POSITIVE REINFORCEMENT 


In this experiment the aversive prop- 
erties of the time out were emphasized by 
terminating the pre-time-out stimulus, 
without a time out, if the rate of re- 
sponding were low enough during its 
latter part. Pauses initiated during the 
pre-time-out stimulus reduce the likeli- 
hood of a time out and make a reinforce- 
ment more probable. Responses emitted 
at higher rates during the pre-time-out 
stimulus, however, are more likely to be 
punished. The contingencies are just op- 
posite to those of Exp. I, where the first 
response go seconds after the appearance 
of the pre-time-out stimulus is followed 
by a time out. There, a pause initiated 
during the pre-time-out stimulus made 
punishment more likely. As a control 
procedure, the frequency of reinforce- 
ments on the variable-interval schedule 
was decreased to every six minutes, on 
the average, a value at which Herrn- 
stein’s experiment showed increased rates 
of responding during the pre-time-out 
stimulus. The experiment was first car- 
ried out with pigeons and then con- 
firmed with the chimpanzees of Exp. I 
and II. 


Pigeons 
Proc edure 


Phe subjects of the experiment were two adult 
pigeons, maintained at approximately 80°; of 
their free-feeding weight. Pecks at a translucent 
key were reinforced on a six-minute, arithmetic 
variable-interval schedule of reinforcement. The 
longest interval was 12 minutes and the shortest, 
several order to maintain the low 
frequency of reinforcement without an exces- 
sively long programming tape, a few of the 
shorter intervals were omitted. The experiment 
began with a procedure similar to that of Exp 
I. A blue light appeared behind the key every 11 
minutes, and the first response go seconds after 
the appearance of the blue light (pre—-time-out 


seconds, In 


: 
| 
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TIME OUT FROM 
stimulus) terminated the experiment for 10 min- 
utes. The procedure was then changed so that 
the blue light went off without a time out if 
the rate of responding were low enough during 
the last part of the pre-time-out stimulus. This 
was done by arranging a short period of time 
in the last part of the pre-time-out stimulus 
(two to five seconds) when a peck would produce 
a time out. If no response occurred, the stimulus 
terminated without a time out. The level of 
deprivation, the length of the  pre-time-out 
period, and the portion of the pre-time-out 
period during which a response would shut off 
the experiment were manipulated so as to mini- 
mize the number of time outs. This was done 
by increasing the bird’s weight, reducing the 
length of the pre-time-out stimulus, and reduc- 
ing the length of the period at the end of the 
pre-time-out stimulus until the rate of respond- 
ing in the pre-time-out stimulus became zero 
Then, the original values were restored: 80°; 
body weight, and a go-second pre-time-out stim- 
ulus, with responses during the last five seconds 
shutting off the experiment. When suppression 
of responding during the pre-time-out stimulus 
was complete, the original pre-time-out condi- 
tions were reinstated; that is, the first response 
go seconds after the appearance of the pre-time 
out stimulus shut off the apparatus for 10 min 
utes, 

Ihe start of the pre-time-out stimulus is indi- 
cated on the records by the diagonal movement 
of the recording pen 
indicated. 


Results 
The first peck 30 seconds after the 


appearance of the blue light produces a 
time out. 


Reinforcements are not 


The results confirm the earlier experi- 


Fic. 5 
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ment with chimpanzees (Exp. 1) where 
the time out produced increased rates 
of responding during the pre—time-out 
stimulus. 

First bird. Figure 5 shows the final per- 
formance for the first bird, after 51 hours 
of variable-interval reinforcement and 43 
hours of reinforcement with the pre- 
time-out procedure. The figure contains 
a complete session except for two hours 
omitted between Records A and B and 
Records B and C. Without exception, the 
rate of responding is normal during the 
pre-time-out stimulus, even though long 
pauses and low rates of responding are 
common elsewhere, particularly after a 
time out, for example, at e. The magni- 
tude of the pre-time-out rate of respond- 
ing varies considerably. At a and ¢ it is 
much below the prevailing rate. The 
average rate of responding is consider- 
ably higher during the blue light than 
elsewhere, because responding is always 
sustained during the pre—time-out stimu- 
lus, while pausing occurs frequently else- 
where. 


Second bird. The second bird was only 


briefly exposed to the pre—time-out pro- 


cedure (10 hours), and the responding 
during the pre-time-out stimulus was 
incompletely developed. 


10 MINUTES 


First bird. The first peck go seconds after the appearance of the blue light produces a time out, 
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Fic, 6. First bird. Final performance showing suppression of responding during the blue light. Only 
responses during the final 5 seconds of the pre-time-out stimulus produce time outs. 


Only responses during the latter part 
of the pre-time-out stimulus procedure 
produced a time out. 


When the pre-time-out stimulus was 
allowed to terminate without a time out 
if the rate of responding were low 
enough, responding was almost com- 
pletely suppressed during the pre-time- 
out stimulus, 

First bird. Figure 6 shows the final per- 
formance on a go-second pre-time-out 
stimulus, with standard food deprivation 
and responses during the last five seconds 
producing a time out. This performance 
was obtained after the following history: 
14 hours in which the bird’s weight was 
increased and the pre-time-out stimulus 
reduced to 15 seconds, with only  re- 
sponses during the latter 3 seconds pro- 
ducing time outs; 24 hours of an 18- 
second pre-time-out stimulus, with only 
responses during the last 5 seconds pro 
ducing time outs. A period of 8 hours 
was omitted between Records A and B. 
In almost every case, suppression of re 
sponding was complete during the pre 
time-out stimulus, as at a, b, and c. Dur- 
ing the entire session, only 8 responses 


occurred during 78 presentations of the 
pre-time-out stimulus, and all of these 
occurred during the early part of the 
pre-ume-out stimulus where they do not 
produce time outs, 
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Second bird. The second bird also 


showed complete suppression during the 
3o-second pre—time-out period. During 37 
presentations of the blue light, only 9 
responses occurred, but none during the 
period when they would produce a time 
out. In most cases, responding began im- 
mediately following the termination of 
the blue light, although the over-all rate 
of responding occasionally fell to zero 
with several successive presentations of 
the pre-time-out stimulus without any 
responding in between. ‘The bird's his- 
tory included 16 hours on this procedure 
in which it made no progress toward a 
suppression of responding during the 
pre-time-out stimulus. For 43 hours the 
weight of the bird was raised and the 
length of the pre-time-out stimulus then 
reduced to 12 seconds, with responses 
during the last 3 seconds producing a 
time out. 


Return to the original pre-time-out 
prow edure; the first response after 30 Ssec- 


onds produces a time out. 


The return to the original time-out 
procedure again produced substantial 
rates of responding during the pre—time- 
out stimulus. 

First bird. Record A of Fig. 7 is the 
start of the session following Fig. 6. Sup- 
pression was complete during the first 
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pre—time-out stimulus, at a. At the arrow, 
the procedure was changed so that the 
first response go seconds after the appear- 
ance of the blue light produced a time 
out. The blue light caused a zero rate, 
and no responses occurred during the 
remaining 16 hours of the session. The 
following session, Record B, began with 
the blue light on, and sporadic respond- 
ing during the pre-time-out stimulus 
produced a time out after a pause of a 
few seconds. Records B and C show the 
remainder of the session, with 3 hours 
omitted in between. Responding was sus- 
tained during the pre-time-out stimulus 
with frequent instances of a rate higher 
than the prevailing rate, as at c, d, e, g. 
and h. The effect is somewhat more 
marked than that occurring during the 
final performance in Fig. 6. Pauses occa- 
sionally followed the time out, as in the 
segment at f, 
compensation. 


which also shows some 

Second bird. The second bird’s tran- 
sition was similar. When the blue light 
remained on instead of terminating after 
go seconds, no responses occurred for 
almost 20 minutes, and the pre-time-out 


stimulus was turned off, ad libitum, with- 
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out a response or a time out. Responding 
began soon thereafter, and the next two 
presentations of the pre-time-out stimu- 
lus showed complete suppression, with 
The fol- 
lowing session began with complete sup- 
pression during the pre—time-out stimu- 
lus; and following the third presentation 


some intervening responding. 


of the pre-time-out stimulus, the pro- 
cedure was changed so that the first re- 
sponse after 30 seconds produced a time 
out. The blue light remained on for 8 
hours, when no responses occurred. The 
following session began with the pre- 
time-out stimulus in effect, and a single 
response during the blue-light stimulus 
produced a time out, Thereafter, the rate 
of responding during the pre-time-out 
stimulus increased, reaching values to- 
ward the end of the session which were 
roughly equal to the prevailing local 
rate. After further exposure to the pre 
time-out procedure, responding was sus- 
tained during the pre-time-out stimu 
lus, with frequent instances of high rates 
of responding. Rates of responding lower 
than the prevailing rate continued to oc- 


cur, particularly toward the beginning 
of the session. 


The rate of responding 


Fic. 7. First bird. Record A: Before the arrow, the blue light terminates if no pecks occur during 


the last 5 seconds 
interrupts the experiment Records B and ( 


seconds after the blue light produces a time out 


At the arrow, the first response go seconds after the appearance of the blue light 
The session following Record A. The 


first response go 


A B C 4 
/ 
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OMITTED / 
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during the pre-time-out stimulus was 
approximately equal to the prevailing 
rate, and the performance was approxi- 
mately the same as that which occurred 
earlier under the same procedure. 


Chimpanzees 
Procedure 


The procedure reported for pigeons was car 
ried out with chimpanzees No. 67 and 97. At 
the start of the experiment, the over-all rate of 
responding was low because of punishment of 
fast responses in a previous experiment. The 
pre-time-out stimulus (red light) was then pre 
sented every eight minutes. The first response 
go seconds after the appearance of the red light 
produced a time out. After 12 sessions for No. 
97, and 9 sessions for No. 67, the rate of respond 
ing during the red light was approximately 
equal to the over-all rate. The procedure was 
then changed to emphasize the aversive proper- 
ties of the time out by allowing the red light 
to terminate without a time out if the rate of 
responding were low during its latter portion, As 
with the pigeons, the length of the pre-time-out 
stimulus and the portion of the stimulus in 
which a response would produce a time out were 
varied so as to minimize the number of 
outs, When the rate of responding during the 
red light became low enough so that nearly all 
of the pre-time-out stimuli terminated without 
a time out, the original values were reinstated. 


time 


Results 

Suppression of lever pressing during 
the pre-time-out stimulus. Number 97 
showed suppression during the pre—time- 
out stimulus after the following history: 
six sessions of a 20-second, pre-time-out 
stimulus with responses during the last 
five seconds producing time outs; three 
sessions where responses produced time 
outs during the last two seconds; and 
two sessions where responses produced 
time outs during the last five seconds. 
The length of the pre-time-out stimulus 
was then increased to go seconds, and 
Record A of Fig. 8 contains the entire 
second session. The over-all rate of re- 
sponding was still lower than in Exp. I, 
II, and IV, probably because high rates 
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8. Record A 


hic. 
performance 
onds of the go-second red light produce a time 


Chimpanzee No. 97. Final 
Responses during the final 5 sec 


out. The oblique marks indicate the extent of 
the pre-time-out stimulus. Record B: Chim- 
panzee No. 67 


of responding were punished in a pre- 
vious procedure. Suppression of levey 
pressing during the red light was vir- 
tually complete, with only one time out 
occurring (at c) and only 19 pre—time-out 
responses through the entire session. A 
few responses appeared in the middle of 
the interval, at 6, and at the start of the 
interval, at d. The pre-time-out stimulus 
substantial 
rate of responding, as at a; but the low 


occasionally interrupted a 
over-all rate provided many instances 
the 
curred when the rate of responding was 


where pre-time-out stimulus oc- 
zero, as at @. 

As in Exp. I, II, and IV, No. 67 showed 
greater sensitivity to the effects of the 
time out. By the second session of a 20- 
second pre-time-out stimulus, with re- 
sponses in the final five seconds produc- 
ing a time out, suppression of lever press- 
ing in the presence of the red light was 
complete. No time outs occurred during 
the entire session, and only two responses 
occurred during the pre-time-out stimu- 
lus. Record B of Fig. 8 contains an entire 
session, showing suppression during a 3o- 
second pre-time-out stimulus after a his- 
tory the same as that of No. 97. The 
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over-all rate of responding was low, as 
with No. 97, probably because of the 
previous history of punishment of fast 
responding. 

The first response after the 30-second 
red light produces a time out. Even after 
prolonged exposure, this procedure did 
not produce as sustained a rate of re- 
sponding during the pre—time-out stimu- 
lus as during the previous performance 
on the same program. 

The transition was very similar to that 
after the same procedures in the pigeon 
experiment, although not so extreme. 
Long pauses appear in the pre—time-out 
stimulus and elsewhere, with a corre- 
sponding decline in the over-all rate. 
When responding occurred, however, it 
occurred at normal rates of responding. 
No. 67, the animal with the low rate and 
greater reactivity to all of the previous 
time-out procedures, again exhibited a 
larger effect of the change in procedure. 
The over-all rate of responding fell to 
near zero for the last three hours of the 
session. Only 36 of the possible 58 rein- 
forcements were delivered. The proce- 
dure was continued for 22 sessions, dur- 
ing which both the over-all rate and the 
rate during the pre—time-out stimulus 
rose; but the pre-time-out rates of re- 
sponding sull did not exceed the prevail- 
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Fic. g. Chimpanzee No. 97. The first response 
after go seconds in the red light produces a time 
out. 


Twenty-two sessions after the suppression 
during the previous procedure 


ing rates of responding. Figures g and 10 
show the final performances. The over-all 
rates of responding remained high for 
both animals, and the frequency of nega- 
tively accelerated rate changes during the 
red light increased, as, for example, at 
a, b,c, d, e, f, and g in Fig. g and a, b, 
c, d, and e in Fig. 10. Occasionally, No. 
67's rate of responding during the red 
light was near zero, as at f and g. Figure 
11 shows the performances for both ani- 
mals during the red light with less reduc- 
tion. The segments of the curve in the 
vicinity of the pre-time-out stimulus are 


excerpted and arranged in order of oc- 
currence, in Record A for No. 67 and 
Record B for No. 97. 

Only responses during the last five sec- 
onds of the red light produce a time out. 


Fic. 10. Chimpanzee No. 67. The first response after go seconds in the red light produces a time out. 


Twenty sessions after the suppression during the previous procedure. 
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Fic. 11, Excerpts showing the performance 
during the red light with less reduction. Record 
\: Chimpanzee No. 67, Record B: Chimpanzee 
No 


Neither No. 67 nor No. 97 progressed 
further toward sustained responding dur- 
ing the pre-time-out stimulus than the 
performance already described in Fig. 9 
and 10. The procedure was therefore 
changed to find out the extent to which 
the earlier performance could be recov- 
ered when the pre-time-out stimulus 
could terminate without a time out if the 
rate of responding were low enough. The 
pre-time-out stimulus was reduced to 15 
seconds, with only responses during the 
last 2 seconds producing time outs. After 
three sessions, the rate of responding dun 
ing the red light became low enough so 
that no time outs occurred, and that por- 
tion of the pre-time-out stimulus was in 
creased in which a response would pro- 
duce a time out. 

Number 67 


sitivity to the etlects of the time out. Sup- 


again showed greater sen- 


pression during the pre-time-out stimu- 
lus was virtually complete by three ses- 
sions, With only 34 responses occurring 


during the 18 presentations of the pre 
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time-out stimulus. The bulk of these oc- 
curred during one pre—-time-out period. 
The performance for No. 97 is shown in 
Fig. 12, where segments have been ex- 
cerpted in the vicinity of the pre—time- 
out stimulus and arranged vertically in 
order of occurrence. In spite of the large 
amount of responding during the pre- 
time-out stimulus (g72 responses), only 
one time out occurs, because most of the 
responding is concentrated during the 
early part. Marked negative acceleration 
occurs in all of the pre-time-out periods 


except the 3rd, 4th, 5th, and 11th. 


Disc ussion 


Both the pigeon and chimpanzee ex- 
periments demonstrate that the time out 
is an aversive event which can suppress 
behavior during a pre—time-out stimulus. 
In the pigeon experiments, it was possi- 


Fic. 12 Return to the 
procedure where only responses during the last 


Chimpanzee No, 67 


5 seconds of the pre-time-out stimulus produce ¢ 
Segments in the vicinity of the pre 
time-out stimulus have been excerpted 


time out 


OUT FROM 


ble, in the same birds, to alternate be 
tween procedures which produced sup- 
pression or sustained responding at rates 
higher than the rate. In the 
chimpanzee experiment, the same ani- 


over-all 


mals which showed sustained responding 
at rates higher than the over-all rate dur- 
ing the pre-time-out stimulus showed 
complete suppression when the pre-time- 
out stimulus could terminate without a 
time out. The subsequent return to the 
first procedure, however, did not increase 
the pre-time-out rates of responding to 
the earlier values (presumably as a func- 
tion of the intervening exposure to the 
procedure emphasizing the aversive as- 
pect of the time out). The increased rate 
during the pre-time-out stimulus is due 
to its effect on the rate of responding at 
the moment ot and _ the 
consequent differential reinforcement of 
high rates. 


reinforcement 


The suppression during the pre-time- 
out stimulus demonstrates a process in 
the control by a time out, which is simi- 
lar to the suppression obtained with elec- 
tric shock. The time out appears to have 
slightly different properties than the elec- 
tric shock in that it has more specific ac- 
tion; that is, it limits the suppression to 
the pre-time-out stimulus. The preshock 
procedure often produces suppression 
elsewhere than during the preaversive 
stimulus, for example (1, 7). 

The pre-time-out stimulus showed a 
high order of control over the pigeons’ 
behavior, with suppression during 8 and 
16 hours, respectively, for the two ani 
mals of the experiment. This order of 
stimulus control occurs in experiments 
with electric shock only at high intensi 
ties of the shock. Following the experi- 
ment producing suppression in the pre 
time-out stimulus, both chimpanzees 
showed many instances of negatively ac- 


celerated rate changes in the pre-time 
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out stimulus under the procedure that 
previously produced sustained respond- 
ing. The suppressive eflect of the time 
out during the final part of the pre—time- 
out stimulus probably re presents the con- 
current operation of the two properties 
of the time out; the sustained responding 
early in the pre—time-out stimulus is due 
to the differential reinforcement of high 
rates by the time out, while the lower 
rate toward the end of the pre—time-out 
stimulus represents a temporal discrimi- 
nation of the aversive eflects of the time 
out. When only responses during the 
latter part of the pre-time-out stimulus 
produced time outs, the temporal dis- 
crimination became more pronounced 
and the complete suppression that de- 
veloped during the first exposure to this 
procedure did not appear. This is similar 
to the 


result’ obtained by 


\vrin, who 
generated near-normal rates of respond- 
ing during the first part of a preshock 
stimulus. 

The pigeons showed no indication that 
a temporal discrimination was develop 
ing, but they were not exposed to the 


procedure as long as the chimpanzees. 


EXPERIMENT IV. AvoIpbANCE BEHAVIOR 


(nother property of an aversive stimu- 


lus is its ability to maintain behavior 


which removes 01 Sidman 


has extensively studied the avoidance of 


postpones it. 


electric shock, with procedures in which a 
free operant is maintained because it 
shock. Morse Herrn- 


stein (13) extended the technique to the 


postpones a and 
avoidance of a time out in the pigeon; 
and in the present experiment, this tech- 
nique is used with the chimpanzee. The 
demonstration of the aversive properties 
of the time out is relevant to the inter- 
pretation of the results of Exp. I and 
III, where findings were analyzed by ref- 


erence to two separate functions of the 


time out. The animals, the schedule of 
food reinforcement, and the level of de- 
privation remain the same. Hence, 
aversive properties of the time out 
rived from the present experiment are 
germane to the interpretation of the 
functions of the time out in those experi- 
ments. 


the 
de- 


Procedure 


The experimental session began with the vari- 
able-interval schedule in force. Two keys sepa- 
rated by approximately 12 inches were present 
simultaneously. Responses on the right key (food 
key) were reinforced on the three-minute, vari- 
able-interval schedule used in the previous ex- 
periment. If no responses occurred on the left 
key (avoidance key), a three-minute time out 
occurred after every 45 seconds of experimental 
time. Each time the avoidance key was pressed 
it postponed the interruption of the experiment 
for a given period of time (RS interval). If the 
avoidance key was pressed frequently enough, 
the variable-interval schedule remained in force 
continuously, Four values of the RS interval were 
studied: 10, 5, 2, and 1 minutes, Figure 13 shows 
the actual sequence and the number of sessions 
in each value for both animals. 

Since the food reinforcement was programmed 
by time, a sequence of responses on the avoid- 
ance key would increase the probability that 
the next response on the food key would be 
reinforced. Thus, the rate of avoidance respond- 
ing would be spuriously inflated (12, 17.) Such 
accidental reinforcement was observed when the 
rate of No. 97's avoidance responding failed to 
fall following the increase of RS interval from 
2 to 10 minutes, To prevent this spurious rein- 
forcement, the timer programming the food- 
reinforcement schedule stopped for seven seconds 
every time an avoidance response occurred, This 
was done with both animals, This procedure in- 
creased the mean of the variable-interval sched- 
ule somewhat; but it ensured that the level of 
avoidance responding would not be inflated by 
reinforcement because of a spurious chain of 
responses. 

The avoidance experiment began following the 
procedures already described in Exp. I and II. 
No responses occurred on the avoidance key for 
several sessions, however; and, because some re- 
sponding was necessary before the avoidance con 
tingency would have any effect, the food key was 
withdrawn for 30 minutes during which avoid- 
ance-key responses reinforced 


were by food on 


the variable-interval schedule. The food key was 
then replaced and the avoidance procedure re- 
instated, 
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Responding on the food and avoidance keys 
was recorded on separate cumulative recorders 
running concurrently. The displacement of the 
recording pen diagonally from the curve marked 
the occurrence of reinforcement on the 
variable-interval curve and time outs on the 
avoidance curve. The recorder stopped during 
the time out, and the location of the time outs 
on the variable-interval curve is indicated by the 
small filled circles shown above the curve in 
Fig. 16. Figures of the avoidance behavior con- 
tain entire daily sessions. 


food 


Results 


The results of the entire experiment 
are summarized in Fig. 13, which gives 
daily rates of responding for each session 
on the food and avoidance keys, as well 
as the frequency of occurrence of time 
outs. All of the sessions of the experi- 
ment are included, and each point is the 
average rate for the daily session. In gen- 
eral, the rate of avoidance responding in- 
creased when the interval by which each 
response postpones the time out was de- 
creased, and vice versa. On all values of 
the avoidance schedule, rates of respond- 
ing were considerably higher than the 
minimum amount of behavior necessary 
to postpone all of the time outs. Re- 
sponding tended to occur in bursts at 
sustained rates rather than in single re- 
sponses emitted at approximately the 
rate corresponding to the avoidance in- 
terval. 

Chimpanzee No. 67. Figure 14 gives 
the early development of the avoidance 
behavior. Record A, the sixth session in 
which 


each avoidance 


response post- 
poned the time out for 10 minutes, shows 
a very low rate of responding—one which 
is just sufficient to keep the schedule of 
food reinforcement in force continuously 
during most of the session. Seventy re- 
sponses are emitted during the session, in 
bursts of 2 to 10. Record B contains the 
performance in the procedure where 
avoidance responses postponed the time 


out for 5 minutes (RS 5). It shows a 
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Fic, 15. Chimpanzee No, 67. Transition 
higher over-all rate than that under RS 
10 and a progressive decline in rate 
through the session. Intermediate rates of 
responding are absent, with most of the 
avoidance responses occurring In groups 
of 20 to 6o, emitted at 2 responses per 
second. Record C contains the avoidance 
performance after g sessions on RS 2. The 
over-all rate increases over twice that of 
the previous procedure, but a larger num- 
ber of time outs occur, particularly to- 
ward the end of the session, because of the 
progressive decline in the over-all rate. 
Avoidance responding is absent for peri- 
ods up to 5 minutes, during which three 
to four time outs occur in a row. Inter- 
mediate rates of responding are still ab- 
sent, although the size of the bursts is 
decreasing. 

Figure 15 shows the transition of the 
RS 10 and the 
Record <A, 


containing the session following Fig. 14C, 


avoidance behavior to 


subsequent return to RS 2. 


shows the re-exposure to the longer RS 
interval. The session begins with the 
high rate of avoidance responding from 
the previous shorter RS interval; but the 
rate of responding falls progressively, 
reaching a low over-all rate of respond- 
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to RS 10 and subsequent return to RS 2 


FERSTER 


ing consisting of long pauses separated 
by bursts of approximately 25 responses, 


as at 4, 6, and c. 


Fight sessions later, 
shown in Record B, the rate of avoidance 
responding remains substantially higher 
than in the final performance previously 
recorded in Fig. 14C. This level had been 
reached after the fourth session on RS 
10. Because the rate of avoidance re- 
sponding might be spuriously inflated as 
a result of accidental reinforcement, the 
procedure was then changed so that the 
tape scheduling the variable-interval re- 
inforcement stopped for seven seconds 
each time an 


avoidance response oc- 


curred. Thus, responses on the avoidance 
the likelihood 


that subsequent responding on the varia- 


kev no longer increased 
ble-interval key would produce a_rein- 
forcement. Record C shows the perform- 
ance four sessions after the initiation of 
the control procedure. The rate of re- 
sponding falls to a level only slightly 
above the previous final performance on 
RS 10. Some sustained bursts of respond- 
ing are still occurring, as at d, but inter- 
mediate rates of responding have become 


much more frequent, as at e, f, and g. 


The number of time outs is now com- 
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Chimpanzee No. 67. Food-key per 
formances corresponding to the avoidance be 


havior of Fig. 14 and 15 


parable with that recorded under the 


previous RS 10 procedure. The RS inter 
val was then reduced to two minutes; 
Record D shows the performance 
three sessions on this value. 


responding has increased considerably 


over the performance recorded previ- 


ously under RS 10 in Record C; but it 


is much less than the performance re- 


corded earlier under RS 2 in Fig. 14. 
This is largely a result of the disappear- 
ance of the sustained bursts of respond 


ing at high rates. Instead, the perform 
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Chimpanzee No. 67. Seven consecutive 
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The rate of 


sessions showing the 
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ance has given way to a finer grain in 


which many responses are occurring 
singly, or in groups of two or three, as 
at 7 and J. Instances still occur, however, 
where avoidance responding is sustained 
at high rates for large numbers of re- 
sponses, as at h and k. 

The corresponding performances on 
the food key are shown in Fig. 16, 
which gives the first hour of the session. 
The order of presentation of the seg- 
ments has been inverted for more com- 
pact presentation. Records A and B are 
the food-key performances, comparable 
with Fig. 14 and 15 on RS 10. Record C 
shows the increase in the variable-inter- 
val rate of responding on the first session 
the RS interval increased to 
minutes. Records D and F 
8th and i2th sessions on the second ex- 
posure to the RS 10, Record F 
shows the subsequent increase in rate of 
responding on re-exposure to RS 2 in the 
final session. 


was two 


contain the 


and 


When the RS interval was decreased to 
one minute, the rate of responding began 
to decline continuously, finally reaching 
a value intermediate between the lowest 


RS 10 value and the performance unde 


RS 5. Figure 17 shows the second through 


development of a temporal 


discrimination in the avoidance responding 
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22 CHARLES 
the eighth sessions in reduced form. The 
over-all rate of responding declines con- 
tinuously, because of the progressive dis- 
appearance of bursts of responding at 
high rates. By Record G, responding is 
sustained at a low constant rate, just 
sufficient to postpone most of the time 
outs. The frequency of time outs is 
higher toward the end of the session. 
Figure 18 shows the final performance 
in greater detail. The avoidance behavior 
in Record B occurs at a low constant rate 
of responding, just sufficient to postpone 
most of the time outs. A brief burst of 
responding at a high rate occurs at a. 
The variable-interval performance on 
the food key, Record A, shows the in- 
crease in the variable-interval 
rate. The small arrows over the curve in- 


over-all 


dicate the exact locations of the time 
outs. Most of the time outs occur while 
the variable-interval performance is sus- 
tained, except for the group of eight 
time outs toward the end of the sessions, 
which occur during a pause. Nearly all of 
the time outs are followed by a brief 
pause in the variable-interval perform- 
ance. 


Throughout the experiment the over- 
all rate of responding on the food key 
went up whenever the number of time 
outs increased and decreased whenever 
the number of time outs fell. This rela- 
tion confirms the findings of Exp. I and 
II on the effect of an ad libitum time out 


Fic. 18. Chimpanzee No. 67 


. Final performance showing full development of a temporal 
discrimination. 


FERSTER 


on a variable-interval performance. 

Chimpanzee No. 97. The second ani- 
mal in the experiment did not show so 
strong a disposition to emit large bursts 
of responding on the key 
during the early parts of the experiment. 


avoidance 


However, the avoidance rates of respond- 
ing increased markedly under RS 1 to- 
ward the end of the experiment. Some 
evidence existed that temporal discrimi- 
nation had started to form under RS 1, 
as with No. 67, but the experiment was 
discontinued too soon to show its devel- 
opment. 

As in the previous experiments, No. 97 
was less sensitive to the aversive effects of 
the time out. 


Discussion 


The present experiment confirms 
Morse and Herrnstein’s result with the 
pigeon and shows that the postponement 
of a 10-minute time out from a variable- 
interval schedule of food reinforcement 
will maintain a substantial amount of 
behavior in a chimpanzee. The results 
also extend the generality of the aversive 
properties of the time out from this 
schedule of reinforcement, and support 
the interpretation of the results of Exp. 
Il. 

The avoidance behavior based on time 
out positive reinforcement has 
some of the properties of avoidance of 
electric shock studied extensively by Sid- 


© minutes 


8 


TIME OUT FROM 


man. Over most of the range studied in 
this experiment the rate of avoidance re- 
sponding varied inversely with the RS 
interval (15). With prolonged exposure 
to the avoidance contingency, avoidance 
rates tended to be progressively lower 
because of the development of a tem- 
poral discrimination. The initial rate of 
development of the avoidance behavior 
was similar to the results with electric 
shock in the rat, cat, and monkey, al- 
though the 10-minute RS interval in 
the present experiment was considerably 
larger than the values customarily used. 

The high chimpanzee avoidance rate 
was characterized by bursts of responses 
separated by pauses, rather than the 
steadier intermediate rates of responding 
of the rat, cat, and monkey. Immediately 
following a time out, the rate of respond- 
ing of the chimpanzee is uniformly low. 
With the rat, cat, and monkey experi- 
ments, however, shocks tend to be fol- 
lowed by a burst of avoidance respond- 
ing. Because species properties are con- 
founded in the relevant experiments, it 
is impossible to say yet what properties 
of avoidance behavior based on a nox- 
ious stimulus are different from those of 
avoidance behavior based on time out 
from a schedule of positive reinforce- 
ment. The large amount of uniformity 
in the properties of electric-shock avoid- 
ance over a wide range of vertebrates sug- 
gests that the important condition is the 
use of the time out rather than the spe- 
cies difference: Avoidance of time out 
from positive reinforcement has not been 
studied in other species extensively 
enough so that the role of the species in 
this behavior can be assessed. Experi- 
ments on the pigeon in which the time 
out was used as a punishment (see Exp. 
V) suggest that the pigeon is less sensitive 
to this contingency than the chimpanzee. 
The progressive increase in the rate of 
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responding on the food key during the 
last exposure to RS 10, 2, and 1 minutes 
occurs independently of changes in the 
avoidance rate. The magnitude of the 
increase of the food-key rates is greater 
than the change in the avoidance rates, 
and cannot be due to a simple shift of 
responses from the avoidance key to the 
food key. Nor is the increased food rate 
due to the periodically recurring time 
outs, which can of themselves produce a 
Earlier in the 
experiment, equal frequencies of time 


marked increase in rate. 


outs resulted in a much lower food-key 
rate. The increase in the food-key rate 
is probably related to the development 
of the avoidance behavior, and may be 
related to the temporal discrimination 
which developed concurrently on the 
avoidance key. 

Avoidance of a time out from a sched- 
ule of reinforcement raises some ques- 
tions about the basis of avoidance be- 
havior. Most writers discussing avoidance 
of electric shock interpret the perform- 
ance in terms of Pavlovian conditioning, 
based on reflexes elicited by the shock. 
Some feel that the reduction in these re- 
flexes strengthens the avoidance behav- 
ior (10, 11). Others emphasize the punish- 
ment of all than the 
avoidance response with the consequent 
development of these behaviors as condi- 
tioned stimuli for the reflex effects of the 
shock (4, 14, 15). Even though a time out 


from a schedule of positive reinforce- 


behaviors other 


ment undoubtedly has some emotional 
effects, these probably are not of the mag- 
nitude caused by a high-voltage electric 
shock. Yet, avoidance behavior can still 
be maintained at a level comparable with 
that developed using shock. This suggests 
that an aversive stimulus may control be- 
havior independently of its emotional, 
autonomic, or reflex effect. 
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EXPERIMENT V. TIME OUT FROM A 
SCHEDULE OF 


POSITIVE REINFORCE- 
MENT AS A PUNISHMENT 


This experiment, using the same chim- 
panzees as Exp. I-IV, investigates the 
properties of a time out used as a punish- 
ment. A time out followed “fast respond- 
ing” and reduced the rate of respond- 
ing on a variable-interval schedule of re- 
inforcement. Because the variable-inter- 
val schedule and the level of deprivation 
were the same as in the previous experi- 
ments, the results of this experiment, as 
well as the results of the earlier experi- 
ments in the paper, can be used to de- 
scribe the general properties of this time 
out, 

The 
used as a paradigm for studying punish 
the 
sponding that emerges is not easily dis- 


variable-interval schedule was 


ment because constant rate of re 
rupted by the time out independently 
of its aversive effects, as it is in other 
interval schedules. Although a fixed-in- 
terval schedule, for example, has the ad- 
vantages of the sensitivity and reproduci- 
bility of rate changes, the interruption of 
the experiment per se would disrupt the 
fixed-interval performance. Also, an in- 
terval schedule was used rather than a 
ratio schedule because of its moderate 
over-all rate of responding and frequent 
local rate changes. In a fixed-ratio sched- 
ule, with its sustained responding at a 
single high rate, the punishment’ would 
have little differential effect, since very 
few responses would go unpunished. 
Moreover, the the 


schedule factors in 


ratio schedule ditlerentially reinforce 
high rates of responding, which oppose 
the effects of the punishment (7). The 
punishment of responses maintained on 


a fixed-ratio schedule is analogous to the 


differential reinforcement of low rates on 
a fixed-ratio schedule. 
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Only occasional instances of responses 
that qualified for punishment were ac- 
tually fre- 


quency of occurrence of the punished 


punished. ‘Therefore, 
class of responses would be minimally 
constrained and could vary continuously 
over a wide range. 

In the paradigm chosen here to study 
punishment, all responses are reinforced, 
and the punishment is used to reduce the 
frequency of occurrence of a selected 
class of responses. Another paradigm is 
possible in which a time out is used to 
eliminate behaviors which are occurring 
by induction, as, for example, in an ex- 
tinction component of a multiple sched- 
ule, or in the differentiation of the topog- 
raphy of some behavior. ‘These are im- 
portant cases, but the rate of respond- 
ing under the variable-interval schedule 
seemed to be a better case to study first 
because it permits a return to a base-line 
condition. 

For convenience, I shall adopt the 
convention of designating the time be- 
tween a given response and the preceding 
response as an interresponse time (IRT) 
and refer to the punishment of interre- 
sponse times even though the correct 
statement would be the punishment of a 
response having an interresponse time of 
a given value. 


P) edure 


The experiment was carried out following the 
Exp. I through IV. 
Under the punishment procedure, lever presses 


procedures described in 
spaced less than a given interval from a preced- 
ing response were followed by a time out. Every 
such was not punished. The 
variable-interval 


instance, however 


punishment occurred on a 
schedule with a mean of 4.6 minutes and a range 
of g minutes. When the variable-interval punish- 
ment schedule designated a punishment, the first 
thereafter of 


instance a response qualifving for 


punishment was followed by a time out. 


Rec ording 


Both cumulative records interresponse 
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times were recorded. Reinforcements are indi 
cated by the small marks diagonal to the record, 
and the points of occurrence of a time out are 
indicated cither by the small dot or arrow 
over the record. The scale of the record changes 
from figure to figure; but both the ordinate and 
abscissa were compressed equally, so that the 
slopes of the curves are comparable. The inter 
response-time recorder classified all responses 
occurring during the session into those between 
zero and 0.33 second from a previous response; 
0.33 to 0.66; 0.66 to 1 second; 1 to 1.93; 1.33 to 
1.66; 1.66 to 2 seconds; and thence by steps of 
2 seconds until 22 seconds, Because this proved 
to be too fine a grain, not all of these compart 
ments were used in the final analysis. The error 
of the interresponse-time recorder was less than 


Plan of the experiment 


A variable-interval base line was first 
established. Responses occurring within 
0.75 second from a previous response 
were punished as specified by the varia- 
ble-interval schedule designated above. 
This 0.75-second interresponse time 
proved to be too high a value for one 
animal, whose rate of responding was 
so high that nearly all of its responses 
fell within the punished category. The 
contingency was then shifted to the pun- 
ishment of responses spaced 0.33 second 
or less. Performances were then recorded 
as the over-all rate of responding was 
progressively lowered by punishing re- 
sponses spaced 1, 2, and 4 seconds. The 


FROM POSITIVE 


REINFORCEMENT 


300 RESPONSES 


10 MINUTES 


. Final performance on VI 3 


time out was then removed, the variable- 
interval base line without punishment 
recovered, and the punishment proce- 
dure reinstated with responses occurring 
within { seconds of a previous response 
being punished. The experiment was dis- 
continued for five weeks during the vari- 
able-interval reinforcement before the 
reintroduction of the punishment. 


Results 


Transition from No Punishment to Pun- 
ishment of Responses Spaced Less Than 


0.33 Second 


Number 97. Figure 1g contains a final 
performance for chimpanzee No. 97 on 
the variable-interval schedule. The over- 
all rate of responding is high during the 
first 30 minutes of the session but then 
falls rapidly, from 0.75 response per sec 
ond to less than 0.2 response per second. 
Local rates of responding continue to be 
high even toward the end of the session, 
as ata, b, and c, for example. Although 
this markedly negative curvature is a 
reproducible feature at this stage of de- 
velopment, it is an atypical variable-in- 
terval performance and probably a func- 
tion of the previous exposure to the con- 
tingencies of Exp. I, I], and IV. On the 
following session, responses spaced 0.75 
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10 MINUTES 


Fic. 20. Chimpanzee No. g7. The first hour of the first four sessions on the punishment procedure. 


second were punished. The initial effect 
of the punishment is shown in Fig. 20, 
containing approximately the first hour 
of the first four sessions. In Record A the 
over-all rate increases from 1 to 1.5 re- 
sponses per second. This performance is 
maintained throughout the entire ses- 
sion, during which 8,000 responses oc- 
curred, 

Few responses are spaced more than 
0.33 second, and the maximum number 
of time outs (indicated by the arrows in 
Record A only) occur. In the next session 
(Record B), 10,000 responses occurred 
with local rates of responding slightly 
less than g responses per second, so that 
nearly all of the responses in the session 
qualify for punishment. Beginning with 
: the third session (Record C), responses 
spaced less than 0.33 second are pun- 
ished. The rate of responding increases 
even further, reaching 10,300 responses 
in the third session and 12,700 responses 
in the fourth session (Record D), with 
local rates of responding reaching just 
under 4 responses per second. 

Figure 21 contains the entire record of 
the third to eighth sessions in reduced 
form. In Record A, the rate of respond- 
ing begins at the previous prevailing 
rate, but soon falls off to an intermediate 
value somewhat less than that occurring 
at the start of the session during the 


previous variable-interval reinforcement 
without punishment. Despite the marked 
fall in the over-all rate of responding, 
however, the frequency of responses 
spaced less than 0.33 second is high 
enough so that the maximum number of 
time outs is still being received. Records 
B through F contain the fourth through 
eighth sessions, during which the over- 
all rate of responding falls, the negative 
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Fic. 21. Chimpanzee No, 97. Responses spaced 
less than 0.33 second are punished. Third to 
eighth sessions. 


MINUTES 


: 
/ 
| YY 
| Za 


TIME OUT 


Fic. 2: 


FROM POSITIVE REINFORCEMENT 


10 MINUTES 


22. Chimpanzee No. 97. Complete daily session showing the final performance with punishment 


of responses spaced less than 0.93 second 


curvature diminishes, and the number 
of time outs occurring reaches a low 
value. 

The final performance is shown in Fig. 
22, where the figure is reduced less. The 
number of responses emitted during the 
session is still the same as the number 
emitted before the punishment proce- 
dure (Fig. 19), even though responses 
spaced 0.33 second from preceding re- 
sponses have been virtually eliminated 
(see Fig. 24). The marked negative curva- 
ture that previously prevailed has now 
given way to a more constant rate of 
responding. Some negative curvatures 
still exist, however, with the over-all rate 
falling from 0.45 response per second at 
the start of the session to slightly less 
than 0.2 response per second for the re- 
mainder of the session. 

Number 67. The second subject, No. 
67, again showed a greater sensitivity to 
the aversive effects of the time out by a 
progressive decline in the rate of re- 
sponding as responses with larger inter- 
response time were punished. Records 
A-D of Fig. 23 show the development of 
the final performance with the punish- 
ment of responses spaced 0.33 second or 
more. 

Record A contains the final perform- 


ance of the variable-interval schedule 
without punishment. The normal varia- 
ble-interval performance for this animal 
was characteristically lower than that for 
No. 97, and the characteristic negative 
acceleration was absent. The first two ses- 
sions (Records B and C), with punish- 
ment of responses spaced less than 0.75 
second, show a progressive decline in the 
rate of responding, although instances 
of responses occurring within 0.75 second 
of each other still occurred, as the large 
number of time outs indicates. Record D 
contains the final performance 11. ses- 
sions after the criterion for punishment 
was changed to the punishment of re- 
sponses spaced 0.33 second, or less. The 
over-all rate of responding increased 
somewhat, but the frequency of responses 
spaced 0.33 second apart, or less, was 
near zero, as evident from the fact that 
only one time out occurred. 

The interresponse-time distributions 
of No. 67 for the prepunishment sessions 
(Sessions 1~7) show the generally prevail- 
ing low rate of this animal (Fig. 24). Re- 
sponses spaced less than 0.33 second 
rarely occurred, and only 40% were 
spaced 1 second or less. Responses tended 
to occur more equally in all of the IRT 
categories than with No. 97. Responses 


2” 
» 
a R's/SEC 


CHARLES B. 


FERSTER 


Fic. 23. Chimpanzee No. 67. Complete daily sessions showing performances with punishment of 
: 7 


responses spaced less than 0.93, 1, 2, and 4 seconds 


A. Final variable-interval performance. No punishment 


B & 


Responses spaced less than 0.75 second are punished 


D. Responses spaced less than 0.33 second are punished 
FE & F. Responses spaced less than 1 second are punished 


G, H, and I. Responses spaced less than 2 seconds are punished 


K. Responses spaced less than 4 seconds are punished 


spaced less than 1 second showed the 
largest decline in the frequency, when re- 
sponses spaced less than 0.75 second were 
punished in Session 8. The remaining 
categories show progressively less effect 
of the punishment. During the remain- 
ing period of punishment of responses 


spaced less than 0.33 second, the 1-second 
IRT’s fell to near zero; the 2- and 4- 
second IR'T’s showed a marked decline; 
but IRT’s 6 to 18 seconds leveled off at a 


value slightly lower than the prepunish- 
ment base line. 


Figure 25 is a daily plot, for No. 97, of 
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the percentage of the total number of re- 
sponses falling within each interresponse- 
time The 
contains the percentage of the responses 


classification. bottom 


curve 
in a given session which were spaced 0.33 
second or less from a preceding response. 
The second curve contains the percent- 
age of responses spaced 1 second, and so 
forth, as indicated by the figure legend. 
The top curve gives the percentage of re 


Interresponse time summary of the experiment 


sponses spaced 18 seconds apart or less, 
and the difference between the top curve 


and 100°, gives the percentage of re- 


sponses in the daily session which were 
spaced 14 seconds or more apart. 
The transition to the punishment of 


responses spaced 0.75 second or less oc- 


curs on the 10th session. Before this, 10° 


of the responses were spaced 0.33 second 


or less and most were spaced 1 second o1 
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Fic. 25. Chimpanzee No. g7. Interresponse-time summary of the experiment. 


less. Only 10°, of the responses in this 
session are spaced 6 seconds apart or 
more. The first introduction of the pun- 
ishment (Session 10, Fig. 20A) approxi- 
mately triples the frequency of responses 
spaced, 0.33 second, and almost of 
the total responses of the session are 
spaced within 1 second of each other. In 
the second punishment session (Session 
11, Fig. 20B) the rate of responding in- 


creases further, with almost go°% of the 
responses still spaced 1 second or less. 
When the punishment criterion was 
changed to 0.33 second (in Session 12, Fig. 
20C), the rate increased further, with 
75°, of the total responses of the session 
spaced less than 0.33 second and 96% 
spaced less than 1 second, During the 
subsequent decline in the rate of respond- 
ing from Session 14 to 19 (Fig. 21 A-E and 
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Fic. 26. Chimpanzee No. 97. Complete daily 
sessions showing performances with punishment 
of responses spaced less than 1, 2, and 4 seconds. 
A, B, C, and D, 1 second; FE, F, and G, 2 seconds; 
H and I, 4 seconds. 


Fig. 22), the percentage of responses 
spaced less than 0.33 second reached zero 
by the 16th session. Responses spaced 
more than 0.33 second also showed a de- 
cline in frequency, but the decline was 
progressively less marked for the lower 
rates. The frequencies of the various in- 
terresponse times remained stable during 
the remainder of the sessions. 


Punishment of Responses Spaced Less 
Than 1 Second 


Number 97. Figure 26 contains com- 
plete daily sessions for No. 97 in reduced 
form taken from g5 sessions during which 
the punishment criterion was increased 
to 1, 2, and 4 seconds. 

Records A, B, C, and D represent the 


transition to the final performance dur- 
ing six consecutive sessions of punish- 
ment of 1-second IRT’s. Record A, con- 
taining the first session, follows Fig. 22. 
The over-all rate began somewhat higher, 
and the number of time outs increased 
markedly over the value prevailing in the 
final performance with the smaller value. 
By the end of the session, however, the 
rate of responding fell to 0.15 response 
per second, compared with 0.25 response 
per second at the end of the previous 
session. In the second session (Record B) 
the negative curvature was greatly re- 
duced, and the over-all rate of respond- 
ing remained approximately 0.2 response 
per second. A large number of time outs 
still occurred. By the third session (Rec- 
ord C) the over-all rate of responding fell 
to approximately 0.15 response per sec- 
ond; and even though the over-all rate of 
responding was considerably below 1 re- 
sponse per second, instances of responses 
spaced 1 second or less still occurred oc- 
casionally, as the four time outs occurring 
during the session indicate. The final 
Record D, 
where the over-all rate of responding fell 
ever further. Responding at the start of 


performance is shown in 


the session began at approximately 0.15 
response per second and fell to less than 
0.5 response per second by the middle of 
the session. 

Number 67. Number 67's performance 
is shown in Records E and F of Fig. 2, 
containing the sessions immediately fol- 
lowing Record D. The punishment pro- 
duces an almost immediate reduction in 
the over-all rate of responding, along 
with an increase in the number of time 
outs. In Record F, four sessions later, the 
rate of responding was extremely low 
during the first part of the session and 
higher during the latter part. No instance 
of a response spaced less than 1 second 
from a previous one occurred during the 
session. 
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Punishment of Responses 
than 2 Seconds 


Spaced Less 


Number 97. Records E, F, and G of 
Fig. 26 contain the ist, 6th, and 11th ses- 
sions for No. 97. Record E, which follows 
directly from the session in Record D, 
contains the first exposure to the new 
value. The rate of responding and the 
number of time outs do not change, be- 
cause the previous punishment of re- 
sponses spaced 1 second from a previous 
response depressed the rate of responding 
sufficiently so that very few pauses as 
short as two seconds occurred. By the end 
of Record E the new contingency pro- 
duced the lowest rate yet observed. Six 
sessions later, in Record F, the over-all 
rate showed little change. Four time outs 
occurred during the initial high rate at 
the start of the session. By Record G, the 
1ith session, the over-all rate fell even 
further. The negatively accelerated por- 
tion at the start of the session was much 
reduced, and only one time out occurred. 

Number 67. Record G of Fig. 2g, the 
session following Record F, shows the 
first punishment of responses spaced less 
than two seconds for No. 67. There is a 
slight decrease in the rate during the lat- 
ter part of the session and an increase in 
the frequency of time outs. The fourth 
session with this value (Record H) shows 
an even lower rate of responding, with 
fewer time outs; but after a total of 13 
sessions with this value (Record 1), the 
rate of responding increased to a value 
approximately the same as that prevail- 
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"1G. 27. Chimpanzee No. 97. Responses spaced less than 4 seconds are punished. Final performance 


ing when this value was first introduced 
in Record G. 


Punishment of Responses Spaced Less 
than Four Seconds 

Number 97. In Record H of Fig. 26, 
the the 
initial effect of the new contingency was 


session following Record G, 
a slight increase in the frequency of time 
outs and the over-all rate of responding 
during the first part of the session. The 
rate fell markedly by the end of the ses- 
The rate of re- 
sponding on this value is shown in Rec- 


sion, however. lowest 
ord I, taken after 11 sessions. The high 
rate of responding that characterized the 
start of the session heretofore disap- 
peared, and the performance became a 
constant rate throughout the session. Al- 
though the over-all rate of responding 
was already less than a response every 
four seconds, the punishment of the oc- 
casional four-second IRT’s produced a 
further decrease in the over-all rate. The 
rate of responding began to increase in 
the next session, however, reaching the 
final performance shown in Fig. 27, 13 
sessions later. The rate of responding was 
low at the start of the session; but it in- 
creased briefly early in the session in the 
region a to d, with responding during the 
time outs at b and c. For the remainder 
of the session the rate fell, reaching a 
value of approximately that obtained 
earlier in Fig. 26H. 

Number 67. When No. 67's responses 
spaced less than 4 seconds apart were 
punished (Record J] of Fig. 23), the first 
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effect was a decline in the rate of re- 
sponding, followed by an increase in the 
rate five sessions later, in Record K. Note, 
however, that the rate of responding was 
already considerably below the critical 
value at which responses would be pun- 
ished, and the increase in rate of re- 
sponding occurring in Record K resulted 
in only two time outs for the entire ses- 
sion. 


Interresponse-Time Records 


Number 97. The punishment of re- 
sponses spaced less than 1 second during 
the goth to 26th sessions reduced the fre- 
quency of responses spaced less than 1 
second to zero by the 26th session (Fig. 
25). Responses spaced less than 2 seconds 
also declined markedly, but those spaced 
less than 4 seconds declined less. The re- 
maining IRT classes also showed a de- 
cline in frequency, but only of the order 
of 5°%, and reflected an over-all fall in 
rate rather than selective action of the 
punishment. 

The punishment of responses spaced 
2 seconds or less (Sessions 27-39) had 
little effect on the frequency of 2-second 
interresponse times, since this frequency 
was already near zero, As in the 1-second 
case, the effect of the punishment was se- 
lective, with IRT’s nearest the punished 
one than the 
IRT’s. By the goth session, over 30°; 


declining more longer 
of 
the responses were spaced more than 18 
seconds from a previous response. 

The punishment of responses spaced 
4 seconds or less, beginning in Session 41, 
produced a further decline in the rate of 
responding, reaching the lowest value in 
Session 48. Almost 95°, of the responses 
emitted in the session were spaced more 
than 18 seconds, even though only those 
responses spaced 4 seconds or less were 
punished. The decline in rate of re- 
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sponding occurred approximately uni- 
formly in all the IRT classes. The in- 
crease in rate with further exposure to 
the punishment occurred in Sessions 48 
to 54. The frequency of responses in the 
punished category ranged from zero to 
0.04°% and showed the least change. Re- 
sponses spaced between 8 and 10 seconds 
showed the greatest change. 

Number 67. In the case of No. 67 (Fig. 
24) the punishment of responses spaced 
less than 1 second had little effect on 
these responses since the frequenc Vv was 
already near zero. The over-all rate of re- 
sponding fell sharply, however, with no 
differential effect in any of the IRT cate- 
gories under 18 seconds. The rapid de- 
cline in rate of responding continued as 
the criterion for punishment was_ in- 
creased to responses spaced 2 seconds; it 
reached the lowest value on the 29th ses- 
sion. Over 60°(, of the responses in this 
session were spaced more than 18 sec- 
onds, and 35°, were spaced from 8 to 18 
seconds. 

The over-all rate of responding in- 
creased with further exposure to the pun- 
2-second IRT’s and was re- 
flected about equally in all of the IRT 
categories between 8 and 18 seconds. The 


ishment of 


increase in rate was not sustained, how- 
ever, and the rate fel! to a value some- 
what higher than that prevailing previ- 
ously in the vicinity of the 29th session. 

The punishment of responses spaced 
seconds or less, beginning on the 
session, was followed by a temporary in- 
crease in the frequency of responses 
spaced 4 seconds or less, as well as a de- 
crease in the frequency of responses 
spaced more than 14 seconds. With fur- 
ther exposure, responses spaced less than 
10 seconds remained the same, along with 
an increase in the frequency of responses 


spaced more than 18 seconds. 
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10 MINUTES 


Removal and Reinstatement of the Pun- 
ishment Contingency 


Number 97. On the session following 
the performance in Fig. 26, the punish- 
ment was discontinued and the procedure 
remained simply variable-interval rein- 
forcement. Figure 28 shows the entire 
first session. The session began with the 
characteristic low rate until the region 
between a and b, when a slight increase 
occurred followed by a return to the 
prevailing low rate. After approximately 
80 minutes, the over-all rate suddenly in- 
creased in the region d to a value almost 
comparable with that prevailing on this 
variable-interval schedule before the in- 
troduction of the punishment procedure. 
Local rates of responding reached 1.3 to 
1.8 responses per second, and the grain 
of the record consisted of sustained bursts 
of responding separated by abrupt shifts 
to zero rates. Before the end of the ses- 
sion, however, beginning at e, the rate 
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Fic. 28. Chimpanzee No. 97. Removal of the punishment. First session following Fig. 27. 


fell again. Following the performance 
shown in Fig. 28, the over-all rate of re- 
sponding fell markedly, but subsequently 
increased, developing into a performance 


shown in Record A of Fig. 29, taken 
after 15 sessions without punishment. 
The highest over-all rate of responding 
was slightly lower than that which pre- 
vailed at the start of the session before 
the punishment procedure. The total 
amount of responding increased, how- 
ever, because the high initial rate was 
sustained longer before it fell, as, for 
example, in the region e. The fine grain 
of the record shows frequent occur- 
rences of smooth postively accelerated 
segments, terminating abruptly in a 
pause of several minutes, as at a, b, c, d, 
and f. 

The interresponse-time analysis (see 
Fig. 25) shows residual effects of the 
previous punishment. The frequency of 
responses spaced less than 0.33 second 
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Fic, 29. Chimpanzee No. 97. Final performance without punishment (Record A) and the return to 


the punishment of responses spaced less than 4 seconds (Record B). 
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remained near zero, and responses spaced 
less than 1 second were less frequent than 
before the punishment. In the upper 
range of IRT’s a substantial number of 
responses spaced more than 18 seconds 
occurred, compared with the number in 
the first nine sessions of the experiment. 
Most of the responses were spaced less 
than 2 seconds, or more than 12 seconds, 
compared with a more even distribution 
at the start of the experiment. The ex- 
periment was interrupted for five weeks 
between Sessions 58 and 59 with little 
effect. 

On the session following Fig. 29, the 
punishment procedure was reinstated. 
The result is shown in its entirety in Rec- 
ord B. Responses spaced less than 4 sec- 
onds were again followed by a time out. 
The rate of responding was low for the 
first few seconds of the session, similar to 
the start of the previous session (Record 
A). Time outs occurred during this pre- 
riod; and, after a brief increase in the 
rate for approximately 100 responses, the 
rate of responding fell to a low enough 
value for the rest of the session so that 
only six time outs occurred during the 
first part of the session. The rate became 
even lower for the latter part of the ses- 
sion, with no responding occurring 
rapidly enough to qualify for punish- 
ment. The rate of responding was high 
enough, however, so that reinforcements 
were still being received on schedule. 

Number 67. The result of removing 
and reinstating the punishment proce- 
dure was similar for No. 97, except for a 
slower increase in the over-all rate of 
responding when the punishment of fast 
responding was first removed. The cumu- 
lative curves of Fig. 30 describe the tran- 
sition to the variable-interval perform- 
ances without time out and the subse- 
quent return to punishment of responses 
spaced 4 seconds. Record A contains the 
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Fic. 30. Chimpanzee No. 67. Removal of the 
punishment and the subsequent reinstatement. 

A, B, C, and D. Ninth, tenth, fifteenth, and 
nineteenth sessions without punishment. 

E. Reinstatement of the punishment of re 
sponses spaced less than 4 seconds. 


ninth session after the removal of the 
punishment. The 
sponding was essentially that prevailing 


over-all rate of re- 
under the previous punishment proced- 
ure, in spite of an increase in the fre- 
quency of responses spaced zero to 2 sec- 
onds. 

The 
somewhat in the next 
Record B; and by the 
out punishment the 


rate of responding increased 
session, shown in 
15th session with- 
over-all rate in- 
creased more substantially (Record C), 
reaching almost the final performance 
shown in Record D on the 1gth session. 
The reinstatement of the punishment 
contingency at the start of Record E 
produced an immediate fall in rate to a 
value approximately the same as it was 
previously (see Record K, Fig. 29). 


Discussion 


Results of the experiment show that 
the selective punishment of fast respond- 
ing will reduce the over-all rate of re- 
sponding below that normally generated 
by the variable-interval schedule, and 
that the effect is reversible, with the ap- 
proximate return of the original sched- 
ule performance when responses are no 
longer punished. The effect of the pun- 
ishment is not entirely specific to those 
IRT’s that are punished. The punish- 
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ment of a given rate reduces the rate of 
responding the 


value at which no responses would be 


considerably beyond 
punished, suggesting a spread of effect of 
the punishment similar to the effects of 
electric shock. This is illustrated by the 
initial effect of the 4-second punishment 
on No. 97, where the rate of responding 
fell considerably below a response every 
t seconds, so that the subsequent rate 
increase had little effect on the number 
of responses punished. 

The effect of lowering the rate of re- 
sponding by punishment of fast responses 
contrasts with the procedure of lowering 
the over-all rate of responding by with- 
holding reinforcement until a 
rate (differential rein- 
forcement of low rate); the over-all rate 


low 
enough occurs 
of responding remains slightly higher 
than the required rate, with the differ- 
ential rate requirement being met by fre- 
quent instances of spaced responses. 
However, the tendency for the effect of 
the time out to generalize might disap- 
pear with longer exposure to a given 
value. This is suggested by the tendency 
for the punishment to initially depress 
the rate of responding below the value 
necessary to avoid punishment. The sub- 
sequent increase in rate occurred without 
any significant increase in the number 
of punished responses. 

Limiting values probably exist beyond 
which — the 


would be ineffective in reducing the rate 


punishment contingency 
of responding. The maximum value is 
probably a function of the length of the 
time out and the level of deprivation. 
Another limitation might be the ability 
of the animal to react differentially to 
the passage of time. In differential re 
inforcement of low rates by withholding 
reinforcement, for example, the animal's 
performance approximates the contin- 


gency better at higher rates. The per- 
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formance of No. 67, during the punish- 
ment of responses spaced 4 seconds or 
less, suggests that 4 seconds is a limiting 
value for this animal under these con- 
ditions. 

A low rate of responding was gener- 
ated in this experiment by a progressive 
lowering of the rate. The contingencies 
in the situation suggest that a progressive 
program is most efficient; but it is not 
certain that initial prolonged exposure 
to an extreme value would not also be 
effective. 

The large order of control by punish- 
ment with the time out from the same 
schedule of reinforcement used in Exp. 
I, 11, and III gives further support to the 
findings of these experiments that the 
time out has two effects. The high rate 
in the pre-time-out stimulus occurs in 
spite of the general aversive properties of 
the time out demonstrated here and in 
Exp. IV. 

Experiments with pigeons, using simi- 
lar procedures, failed to confirm this re- 
sult. The the time out to 
suppress fast responding in the pigeon 


failure of 


does not imply absence of aversive prop- 
erties of the time out. In the face of other 
kinds of 
been established (Exp. III), the time out 


aversive control which have 
will probably suppress fast responding if 
the proper conditions are found, The 
difheulty is probably related to the eflect 
of the time out in increasing the rate of 
responding, and the prepotency of this 
effect of the time out over the aversive 


properties. 


SUMMARY 


Experiment I. A go-second pre-time- 
out stimulus periodically preceded a 10- 
minute time out from a 3-minute vari- 
able-interval schedule of reinforcement. 
The rate of responding during the pre- 
time-out relative to 


stimulus increased 


TIME OUT FROM 
the over-all rate of responding. This in- 
creased rate was interpreted as a result 
of differential rate reinforcement by the 
selective effect of the time out on the 
spacing of reinforced responses. 

Experiment II, The same _ variable- 
interval schedule of Exp. I was inter- 
rupted every minute by a 3-minute time 
out. The result was a large-order-of-mag- 
nitude rate increase compared with the 
uninterrupted performance. This func- 
tion of the time out was analyzed in 
terms of its relation to the effect of the 
time out in Exp. 1. 

Experiment III, The aversive proper- 
ties of the time out of Exp. I and II were 
emphasized by a procedure permitting 
the pre-time-out stimulus to terminate 
without a time out if the rate of respond- 
ing were low enough toward the end of 
the pre-time-out stimulus. Under this 
procedure the rate during the pre-time 
out stimulus fell to zero. Subsequent ex- 
posure to the same procedure produced 
a performance in which the rate of re- 
sponding in the pre-time-out stimulus 
was negatively accelerated. Time outs 
did not occur because 


the rate of re- 
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